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Abstract 

In source routing, a complete path is chosen for a packet to travel from source to destination. While 
computing the time to traverse such a path may be straightforward in a fixed, static graph, doing so 
becomes much more challenging in dynamic graphs, in which the state of an edge in one time slot (i.e., 
its presence or absence) is random, and may depend on its state in the previous time step. The traversal 
time is due to both time spent waiting for edges to appear and time spent crossing them once they 
become available. 

We compute the expected traversal time (ETT) for a dynamic path in a number of special cases 
of stochastic edge dynamics models, and for three edge failure models, culminating in a surprisingly 
challenging yet realistic setting in which the initial configuration of edge states for the entire path is 
known. We show that the ETT for this "initial configuration" setting can be computed in quadratic 
time, by an algorithm based on probability generating functions. We also give several linear-time upper 
and lower bounds on the ETT. 
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1 Introduction 



In source routing, a complete path is chosen for a packet to travel, from source to destination, within a 
network [TJ [4] . One potential advantage of source routing over dynamic routing is that once the routing 
path is chosen, no routing decisions need be made online. In the case of a fixed, static network graph, in 
which each edge is always available for use, the path's traversal time is simply the sum of the times to cross 
the constituent edges. In a dynamic graph (modeling, for example, an ad hoc wireless network), edges may 
be intermittently unavailable. Specifically, the state of an edge in one timeslot (i.e., present or absent) may 
be random, as well as possibly dependent on its state in the previous timeslot. The time spent traversing a 
route in such a dynamic graph includes both the time spent crossing edges and the time spent waiting for 
them to appear. Unlike in the static case, computing the expected value of this end-to-end traversal time 
within a dynamic graph is nontrivial. This is the problem we study in this paper. 

We assume a discrete (slotted) model of time, over which edges appear and disappear; the state of an 
edge (on or off, or 1 or 0) in one timeslot depends on its state in the previous timeslot. In particular, the 
dynamics of each edge is governed by a Markov chain parameterized by (p,q), the probabilities of an edge 
transitioning from off to on and on to off, respectively. 

The expected traversal time (ETT) for a routing path with n edges depends on n,g,p, the initial edge 
states, and the edge lengths. While the ETT can be straightforwardly estimated by simulation, that method 
suffers from high variance especially at low values of q,p; hence an exact characterization (algorithmic if not 
analytic) of the ETT is desirable. We emphasize that the problem of computing the ETT is surprisingly 
nontrivial. In fact, a highly restricted special case of the problem reduces to computing the highest order 
statistics of an IID sequence of geometric random variables, a problem with an analytic solution which itself 
was nontrivial to prove (originally by [7], later simplified by [2]). 

Corollary 1.1 ([2, 7J) Let h be the number of edges initially absent in a path with n edges, q = 0, p > 0, 
and all edge lengths 0. Then, 

Proof: In the stated special case, the traversal time is simply the time taken until all absent edges appear 
because present edges never disappear (q = 0). Each edge's appearance time is an independent geometric 
random variable. It is known [2] that the expectation of the max of h such variables equals the stated value 
and order-of-magnitude. □ 



1.1 Contributions 

Our main result is an exact 0(n 2 )-time algorithm for computi ng t he ETT for the general (q,p) model with 



edges starting in a specified initial configuration (see Corollary 4.1 of Sec. |4|, using an 0{n 2 )-time algorithm 
(see Theorem 4.1) to compute a family of probability generating functions. This algorithm applies to three 
edge failure models (see Sec. [2|. We also compute the ETT for several special case settings (Sec. §. 



1.2 Challenges and techniques 

Designing a polynomial-time algorithm for the ETT in the general (q,p) setting with known initial state 
requires overcoming several challenges. The ETT can be numerically approximated, assuming an algorithm 
to compute Pr(T = £), by 5^^ =0 t Pr(T = t) for a large enough constant r. Pr(T = r) is nonzero for any 
arbitrarily large r, however, and we seek an exact solution. 

A dynamic programming (DP) algorithm can be given to compute the ETT for a given initial state s in 
terms of all possible next-timestep states (including s itself), but there are exponentially many such states 
and hence subproblems to solve. 

Another natural strategy is to compute the expected time ETT[i) to reach each node i on the path: 
ETT[i + 1] depends not just on ETT[i], but also on the probability that edge + 1) is present at the 
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moment when node j is reached (which cannot be assumed to equal ETT[i]). The state of (i, i + 1) at that 
point depends on its state at the previous point and on the state of (i — 1, z) at the previous point. Since these 
random states are not independent — there is eventually a large but polynomial number of subproblems — this 
leads to a complicated DP with running time 0(n n ). (Such an algorithm relies on transition probabilities 
of collections of edges changing from one state to another over the course of the random-duration process of 
waiting for the current missing edge to appear.) 

Instead, we apply probability and moment generating functions (see e.g. [3 for an introduction) in order 
to obtain a much faster, quadratic-time algorithm. 

2 Preliminaries 

We begin with basic assumptions and concepts. Time is discrete, measured in time steps. Time t refers to 
the beginning of the timeslot t (numbered from 0). Given is a path n + 1 on nodes (0 to n) and n edges. 

Definition 2.1 Markovian (q,p) paths; At time 0, each edge is in some known state. The state of a given 
edge in subsequent timeslots is governed by a two-state Markov chain whose transition probabilities are given 
h P(off^ on) = p, P(off^ off) = 1 -p, P(on^ off) q, and P(on^ on) = 1 - q. 

In the (1,1) setting, edge states alternate deterministically. In the (1 — p,p) setting, an edge's state is 
independent of its previous state. 

Definition 2.2 Edge = (i — has length di, which may in general be a random variable (rv), with 
Di = J2]=i dj and D = D n . Edge lengths are all in the Cut-Through (Cu~X ) model, all 1 in the Store or 
Advance (So/K) model), and nonnegative integers in the Distance (D\st) model. 

Edge state indicates whether a packet can begin crossing the edge and, depending on the precise failure 
model, whether and when it will succeed. If the packet is present at an edge's entry node when the edge 
is on, then the packet immediately traverses the edge; if it is currently off, the packet waits there until 
the edge appears. Edge transmission takes zero or more slots, depending on edge length. With length-zero 
edges, an unlimited number of contiguous on edges can be traversed instantly (modeling situations in which 
transmission times are negligible relative to time scales of disruption and repair [6]). We consider three edge 
failure models. In all cases, the packet requires some nonnegative number of time steps to cross a given link, 
if it is on. The models differ according to what occurs when the link fails prior to the completion of the 
transmission: 

1. Transmission continues while the link is down; it simply cannot start unless the link is up. 

2. The remainder of the packet continues transmitting once the link returns. 

3. The packet must be retransmitted on the link in its entirety. 

Observe that the three models are equivalent in both CuT and So A, but yield different behavior in Dist. 
In model [2j a transmission successfully completes once a total of di on timeslots for edge i occur; in model 
[3J a transmission completes once di on timeslots for edge i occur in a row. 

A possible state or configuration of all edges is represented by a bitstring (e.g. s) of length n. T is a 
random variable indicating time of arrival at node n (e.g. £), with E[T] = ETT. We sometimes write ETT(s) 
to indicate ETT for initial state s, and ETT[i] for the expected time of arrival at node i. We sometimes 
abbreviate Markov chain as MC. 

3 Three special settings 

Before considering the problem in full generality, we consider three nice special settings. 
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3.1 The deterministic setting 

Let the (q,p) = (1,1), and assume each di is a constant. Then the exact traversal time can easily be 
computed. First, consider model [I] Let bi indicate the initial state of edge (i — l,z). 

Proposition 3.1 Let bo = 1 and do = 0. Let A$ = — indicate whether b^+i 7^ and Ze£ fc = 

^^Zq 1 A^. T/ien fee traversal time in model^ is D n + Sl^t) 1 (^ + m °d 2) m Dist, 2n — fc + 1 m SoA ; 
and k in CuT. 

Proof: The traversal time is the sum of the total time spent crossing edges D n and the total time spent 
waiting. At each edge z, we wait one time step in two cases: bi differs from bi-i and d^_i was even, or 
bi = bi-i and d^_i was odd. In SoA, this is D n = n plus J^^Zq 1 (di + A^ mod 2), which is bo plus the number 
of positions i > where b^+i = bi, or n + n — k + 1. In CuT, we have D n = 0, and ^™T (^ + ^ m °d ^) 
is simply k. □ 

Corollary 3.1 The the traversal time Dist in model^ is 2D n — k + 1. 

Proof: Model [2] can be reduced to model [T] by modeling each edge of size di as a sequence of di unit-size 
edges, all with the same initial state as d^, for a total of D n such edges. Because of the chosen initial states, 
k in the resulting instance will be the same as k in the original. □ 

With di > 1 for some z, model [3] does not apply to the deterministic setting because the packet will never 
succeed in crossing di. 

3.2 The (1 — p,p) stochastic model 

Computing the ETT here is straightforward. 

Proposition 3.2 // the edge length for edge (z — 1, z) is given by a rv di, the expected routing time in model 
|7J is ^2iE[di] + n(l —p)/p in Dist, or ^ and n<yl ~ p ^ in SoA and CuT, respectively. 

Proof: The total expected transmission time is J2 i E[dj\. The expected wait for each edge to appear is 1/p 
if the edge is OFF (with probability 1 — p) and otherwise. □ 
We note that when each di is constant, Pr(T = t) for t > D is the probability that t — D times are spent 
waiting at nodes through n — 1, analogous to throwing identical balls into bins: 

Pr(T = t)=( t -f_ + ^- i y(l-p)*- D 

3.3 The (q,p) Markov model in steady state 

If each Markov chain has converged (or mixed) before transmission begins, we have: 

Proposition 3.3 Letp andq both be nonzero. Then MC(q,p) has a stationary distributions = (7r on , 7r OJ j) = 
(-P 2_) 



As a corollary of Proposition 3.2 above, we then have: 

Corollary 3.2 If di is again an rv, the expected routing time in model^is E[di] +n(l —7r on )/p in Dist, 
or n(l + 1 ~p° n ) and n ^ 1 ~ 7r ° r ^ in SoA and CuT, respectively. 

Fig. [l] illustrates paths through space-time corresponding to the progress of the packet traveling from 
node to n, in CuT and SoA. Each such path is composed of segments of moving and waiting. Let m 
be the number of moving segments, each preceded by a wait segment (possibly empty in the first case). 
Let the path be specified by a sequence (see Fig. [TJ {0, 0, fci, tj., &2, £2? • • • ? k m , t m , n, £}, and assume each 
di is constant. Clearly 1 < m < min(n,t + 1 — D). Since edge transmission takes time di the total 
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Figure 1: Analyzing the latency in Markov path graphs. 



latency t obeys t > D = ^2 e d e . Since the state of an edge i over time is governed by a Markov chain, 
the probability of a waiting segment of length t is 7r ff (1 — p) l ~ x p. The probability of some path P = 
{(0, 0), (fci, ti), (&2, £2), • • • , (fcm? ^m)? *)} conditioned on k\ = is given by the following: 



fc-ti-i^fc-fci-i 



■Ooff(i -pY tm 1 p)tt ( 



t t m l /v ^\^_72 k m 1 
on 



= <- m 7T m ff (l-p) f - D -">™ 
\p + qJ \p + qJ 

p n q rn( 1 _ p y-D-m 

(p + q) n 

The probability of path P conditioned on k\ > is the same. A path with exactly m right-bends can be 
generated by independently choosing m—1 right-bending points on the space axis (the first is at k = 0) and 
m points on the time axes, (^~\) and (^J ways respectively, for a total of (™~ J (^J such paths. Then the 
latency probability distribution Pr(T = t) for p > 0, g > is given by: 



min{n,£+l} 

Pr(T = t)= ^ 



n-lWt-m p n g m (l - p)*-^-™ 

m — l) \ m J (p + g) n 



(1) 



4 The Markov model with initial configuration 

Let X^(t) G {0, 1} be the state of link i at time £, where Xi(t) = 1 (resp. Xi(t) = 0) if link i is on (resp. 
off) at time t, and let X(0) = x = (x±, . . . , x n ) G {0, l} n be the initial link state, at time 0. The probability 
transition matrix Pi for link i is given by 

P= ( 1 ~P P \ 

with p (resp. the transition probability that link i jumps from state (resp. state 1) into state 1 (resp. 
state 0) in one timestep. Let P a ^(i,t) = Pr(JQ(£) = b | Xi(0) = a) be the probability that link i is in state 
b G {0, 1} at time t given that it was in state a G {0, 1} at time t = 0. Note that P a ,b(t) does not depend on 
the link's identity since all links are assumed to have the same parameters p and q. Let f3 = 1 —p — q G [—1,1]. 
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It is known pj] that 

Pi,o(t) = to(1-j8*), Pi,i{t)=Tri+TroP t (2) 
Po,i(t) = tti(1 -/?'), Po,o(t)=7r +7ri J 8 t (3) 

for any t > 0, where 7To = <?/ (p + q) and 7Ti = p/ (p + q) are the stationary probabilities that link i is in states 

and in 1, respectively. 

Let Ti be the time at which the packet reaches link z, i.e. the time at which it finishes crossing link 

1 — 1. Let Di = T i+ i — Ti be the time spent waiting for link i to appear plus the time taken to cross 
it. To compute E[T n ], we begin by computing the probability generating function (PGF) of T$, namely, 
Gi yX (z) = E[z Ti \X(0) = x] and for initial link state x = (xi, . . . , x n ) and i = n. Let 

F hl (z) = E [z D * | X,(T,_x) = 1] , F it0 (z) = E [z Di \ X^T^) = 0] 

be the probability generating function (PGF) of Di given that link i was in state 1 (resp. state 0) at time 
T^_i, respectively, and define for all links i G {l,2,...,n}, 

7M = E[A | = 1], 7 ,,o = E[A | X,(T,_x) = 0] 

Note that 7^1 = dF ii i(z)/dz\ z= i and 7^0 = di^,o(^)/d^U=i- 

The computation for the three edge failure models given in Sec. [2] will differ only according to the 
expressions for Fi^(z) and which we derive expressions for below. For any number a G [0,1] let 

a = 1 — a. Note that expressions of the form aa + a/3 are equivalent to a if a = 1 else /?. 



4.1 Computing the PGFs and the ETT 

Theorem 4.1 (Computing Gi jX (z)) For initial state X(0) = x = (x±, . . . ,x n ), we can, given the values 
Fifi(P l ),Fi,i{P l ) f or i from to n — 1 (each of which can be found in constant time by the computations in 
the following section), compute the following in 0{n 2 ) time: 

Gi, x (z) = xxF^z) + x 1 F 1 $(z) 

G iiX (z) = (j)i(z) ■ Gi-i iX (z) + xW • ^i( z ) ' Gi-i iX (/3z), i = 2, . . . , n 

where 

<t>%{z) = 7r F iy o(z) + TrxFi^z), i/j^z) = F iy0 (z) - F itl (z), xW = ^1 - x i^o (4) 

Proof: We prove correctness recursively. The base case (i = 1) follows immediately from the fact that 
T\ — D\. We now show, for expository reasons, that Q holds for i = 2. We have: 

00 

G 2 , x ( z ) = ^2 zt ^[ zD2 \ x ^) =%,Di =t] Pr(£>i =t\X(0)=x) 
t=o 

00 

= Z E[z D2 |X(0)=x,A=t,X 2 (t)=j] xPr(X 2 (t)=j|X(0)=x,A=t) 

t=o je{o,i} 
x Pr(Di = t|X(0) = x) 



J2 zt (^ (z) Pr(X 2 (t) = 0|X(0) = = t) + F 2?1 (z)Pr(X 2 (t) = 1|X(0) = z, D 1 = t)) 

t=o 

x Pt(D 1 = t\X(0) = x) 

00 00 

J2 P<Di = t\X(0) = x) + Y, ■ X(2) • M*) Pr ( D i = *l*(0) = x) 

t=0 t=0 

<h{z) ■ G hx (z) + X(2) • M*) ■ GiAPz) (5) 
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where we have used ([2| and ([3| to derive 

Assume for induction that Q holds for i = 2, . . . , m. We now show that it holds for i = m + 1: 

Gm+l,x(z) 

oo oo 

= ' ' ' J2 Z ^ T=1 UE i zDm =x,D 1 =t 1 ,...,D m = t m ]x Pr(2?i = ti, . . . , D m = t m |X(0) = a?) 



£1=0 t™=o 
00 00 

t 1= o t™=o 



je{o,i} 



/At 

z D ™ \X(0) = X, = ti, . . . , D m = t m , X m+1 ( **) 



/c=l 



m 

x Pr(X m+1 ( X) = J ' |Xw+l(0) = ' Pr(jDl = *i> ■ ■ ■ > A» = t m \X(0) = x) 

k=i 

00 00 

^ r = lt '(^ + iW + ^ 1 ' , -x(m + l)-^ + iW) 

ti=o t m =o 

xPr(£>i =h,...,D m = t m \X(0) = x) 

4> m+ i(z) ■ G m)X (z) + x(m + 1) • ip m+1 (z) ■ G m>x (l3z) 



(6) 
(7) 



where (|6| follows from Q and Q and (|7|) follows from the definition of PGF. 

For complexity, observe that we must compute Gi yX (f3 k ) for i from 1 to n and k from to n — 1, and that 
each such computation is done in constant time. □ 

Corollary 4.1 (Computing ETT) For initial state x = (x±, . . . ,x n ), we can (again given the 0(1) -time 
computable values F^o(/^), for i from 1 to n and j from to n — 1) compute ETT in 0(n 2 ) time: 



T n(x) = X 71 " ^' +7r i7i,i + (7i,o - 7i,i) • XW • Gi- liX (P) 



(8) 



2=1 



Proof: Computing Gi yX (z) for all z is done by Theorem 4.1 in 0(n 2 ) total time. The only additional 
computation time here is 0(n). From this, any statistic of Ti can be obtained. Consider: 



Ti(x) = E[Ti\X(0) =x] 



(9) 



the expected transmission time on links 1, . . . , i given that the system is in state x at time t = 0. 

Observe that Ti(x) = G' ix (l). (By convention, Go jX (z) = 1.) We then obtain the recursion (using the 
fact that &(1) = 7T + TTi = 1, ^i(l) = F i|0 (l) - ^,i(l) = 0, and = 1): 

Ti(x) = xi7i,i +xi7i, 

T^x) = Ti_i(fl:) + 7T 7i,o + 7ri7i,i + (7*,o - 7*,i) ' x(i) ' Gi- liX (P), i = 2, . . . ,n 



which in closed form is (|8|. 



□ 



Observation 4.1 (Computing the probability distribution) Since the entire probability distribution 
of T n (x) is captured by the PGF, G UjX (z), it is possible to retrieve the probability distribution of T n (x) by 
taking repeated derivatives as follows J3j/: 



Pi(T n (x) = k) = 



G { n k l(0) 



k\ 



While computing these may not be feasible in closed form in general, it is easy to perform this computation 
numerically. 
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4.2 Computing F^i(z) and Fi^(z) 

Now that the PGF of T$ has been computed, in order to solve various link failure models, we need to compute 
the PGFs of Di as well, i.e. F ij i(z) and F ij o(z). Let S be the random variable (rv) denoting the time needed 
to traverse a link and Y be the rv denoting the amount of time spent waiting, upon arrival there, for the 
link to turn on. First observe that for all links i G {1,2,.. . , n}: 

F it0 (z) = G Y (z)F itl (z) (10) 

since Di\ Xi (Ti)=o —d Y + Di\ Xi (Ti)=ii (=d indicates equality in distribution) where Y is a geometrically 
distributed rv with parameter p, independent of Di\ Xi (Ti)=i- (A sum of rv's yields a product of PGFs.) In 
our model, since Y corresponds to the duration of an off period of a link, Pr(Y = k) = (1 — p) k ~ x p which 
yields the following PGF: 

Lemma 4.1 For the case of geometrically distributed link off periods (Y), 70 = 7i + ^ 

Proof: Recall that 7^1 = dFi i i(z)/dz\ z= i and 7^0 = dFi${z) / dz\ z= \ and Fi^(z) = Gy (z)Fi^(z). It is easy 
to see that Gy(l) = 1 and dGy(z)/dz\ z= i = ^, whereas i^,i(l) = E [1 \Xi(Ti) = 1] = 1. In this case, we 
have: 

7»,o = dF ii0 (z)/dz\ z=1 

= dG Y (z)/dz\ z=1 * F M (1) + Gy(l) * dFi,!^)/^!^! 
= 1/P + 7i,i 

□ 

4.2.1 Failure model [3} complete retransmission after link failure 

We consider two subcases: 

(a) Successive retransmission times on a link are all identical, denoted by the rv S. 

(b) Successive retransmission times on a link are iid rvs {5, Si, S2 • • • , }• 

Let Gs(z) be the PGF of S. Throughout {W, W\, W 2 , . . .} and {Y, Yi, y 2 , • • •} are assumed to be inde- 
pendent sequences of iid rvs, furthermore independent of S in case (a) and of {S, Si, S2 • . • , } in case (b), 
that are geometrically distributed with parameters q and p, respectively. The rv Wi (resp. Yi) corresponds 
to the zth on period (resp. off period) of a link since the first attempt to transmit the packet. Let 1a be the 
indicator function of the event A. Also, in the subsequent text, the subscript i is implicit in the expressions 
involving Fo(z), F\{z) for notational convenience. 

Case (a): Conditioned on J(T^) = 1, we have 

i>0 V 1=1 ) 
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with Ai(u) = {Wi <u,...,Wi<u, W i+ i > u}. Note that Ai(u)nAj(u) = for i ^ j and ]T i>0 Pr(A i (^)) 
1, for any u. We have 



Fi(z) = £e 



u=0 

oo 



(E t >o^(«) («+E!=iW+^)) 



S = u 



Pr(S = u) 



^Pr(# = ^)z n ^E 



i=0 



^M|S = Ml ( w) = i 



Pr(Ai(u) = l|S = u) 



Pr(5 = 0) + ]T Fv ( S = ^ Pr (^ - M ) X] Gy (^^[^1 W < uY Pr(W < 

u=l i=0 

Pt(S = u)((l-q)z) u 



Pr(5 0)+ l-g^l- G y (z)E[z w \W < u) Pi(W < u) ' 
The latter identity follows from Pr(W = i) = (1 — q) l ~ 1 q, i > 1, which yields 



u-2 



Pr(W > U ) = g £ (1 - g) 4 = g £(1 - g) j - £(1 - q) 1 = (1 - g)"" 1 , U > 1 



i=u—l 

On the other hand, for ii > 1, 



u-1 



i=0 



E[^|iy < u] Pt(W < u) = E[z w \W < u, W = i] Pt(W = i\W < u) Pr(W < 

u— 1 u— 2 ^ ✓ x \u—l 

= J2z i Pv(W = i)=qzJ2((l-Q)z) i = qz^- [[L - q)Z) 



i=0 



(1-9)* ' 



so that 



= Pr(S = 0) 



E 



(l-(l-p)^)(l-(l-g)^) 
1-9 

Pt{S = u)((l-q)z) u 



- (1 - (1 - p)«)(l - (1 - q)z) - pqz^l - ((1 - q)z)"-i) 



by using (11). From (10) we deduce 



F (z) = Pv(S = 0)+pz 



l-(l-q)z 



1-9 



E 



Pr(S = u)((l - q)zf 



<_ (1 - (1 - p)z)(l - (1 - g)*) - pqzHl - ((1 - q)zy-^) 



If 5 = 1 (i.e., SoA), we have 



Fo(z) 



pz 



-p)z 



, F^z) = z 



And if S = (i.e., CuT), we have 



Case (b): Conditioned on X(Ti) = 1, we have 



i>0 \ 1=1 

with . . . ,^+i) = {VTi < ui,...,Wi < iH,Wi+i > u i+1 }. Hence, 



F 1 (z) = J2 Pr (^i> • • • . S i) = !) E P %+EU(l " 1+yi)) I ■■■,#) = ! 

2 = 

oo 

= ^Pr(W < RyPr(W > S)Y(zYE \ z ^ Si + 1+ ^ Wl > | 5i > Wi,...,Si > < Wi+i 



2 = 

OO 



53Gr(^)*(Pr(W < SJE^IW < S^Pr^ > S)E[z s \W > S] 



i=0 



Pr(W > S)E[z s \W > S] 



1 - G Y (z) Pv(W < S)E[z w \W < S] 
Let us concentrate on E[z s \W > S] Pr(W > S) and E^IW < S] Pr(W < S): 

E[z s \W > S] - £ Pr(S - ^ > 5) - ^ S - " + £ |; ( ; P ,t ,° F,(W ' ^ 



(12) 



u=0 



Pr(S = 0) + E~ i z u Pr(5 = «)(!- g)"" 1 _ (G s ((l - q)z) - qPr{S = 0)) 



or 



Pt(W > S) 
E[z»\W > S]Pv(W >S) = 



(l-g)Pr(W > 5) 



S .w > ,1 ,v n > = (g5((l-g)*)-pPr(S = 0)) 

(1-9) 



and 

£[2^1^ < S]Pv(W < S) 



= qz 



Pv(W <S)J2z w = w\W < S) 

W — l 

OO oo oo 

^2z w Pt(W = w)Pr(S >w) = qzJ2((l-q)z) W ~ 1 E Pr ( S = u "> 

w=l w=l u=w-\-l 

1-((1- ,/)-)'< 1 



u=2 



u>=l 



u=2 



(l-q)z 



Substituting into ( 12 ) yields: 



g(Gg((l - g)z) - Pv(S = 0) - Pr(S = 1)(1 - g)z)) 
(l-q)(l-(l-q)z) 

(Gs((l - q)z) - qP?{S = 0))(1 - (1 - q)z)(l - (1 - p)z) 



(1 - (1 - p)*)(l - (1 - q)z)(Pv(S = 0) + Pr(S = 1)(1 - g)* - G s ((l - q)z)) 
4.2.2 Failure model [2} transmission is resumed after link failure 

Let us compute F\(z). Conditioned on X(Ti) = 1, we have Di = S + YlY=i wnere V 1S a binomial rv with 
parameter q and population 5 — 1. Note that given a population S = u-\- 1, Gy(z) = 1 — g(l — z)) n . If a sum 
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of rv's Z = X\ + X2 + • • • + Xn where X^s are iid rv's and N is also a rv, then Gz(z) = Gn(Gx(z)) [2]- 
Hence we can write: 



Fi(z) = Pr(5 = 0) + ^Pr(5 = ^)z n [l-g(l-Gy(^))] n - 1 

u=l 

G s (l - q(l - G Y (z))) - Pr(5 = 0)^(1 - Y{z)) 



F (z) = G Y (z) 



l-q(l-G Y (z)) 
G s (l - q(l - G Y (z))) - Pv(S = 0)q(l - G Y (z)) 



l-q(l-G Y (z)) 

4.2.3 Failure model [1} already started transmission is unaffected by link failure 

This is by far the simplest scenario: 

F^z) = G s (z), F (z) = Gy(z)G s (z) 

5 Discussion and future work 

In this paper we exactly computed the expected time to traverse a dynamic path with edge states governed 
by Markov chains. Natural interesting generalizations include edge failures that are not independent; for 
example, adjacent pairs of edge failures would correspond to a node failure, and probability qi,pi that 
vary by link. Our algorithms maintain the same complexity as long as pi + qi is constant, but in the full 
generalization become exponential-time. These techniques have applications in modeling communication 
along military convoys traveling through rugged terrain, and sensor network-based monitoring of linear civil 
structures such as bridges or trains. 
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